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PREFACE 



This monograph investigated the factor structure of the Social Learning 
Environment Rating Scale (SLERS), an instrument designed to quantify teacher- 
.student behavior based on the Social Learning Curriculum (SLC). It is the 
first of an empirical trilogy dealing with the examination of a classroom 
observational system developed within the framework of the SLC. The second 
monograph is concerned with the relationship between the factor structure 
underlying the SLERS and specific student outcome measures. The third monograph 
examines types of verbal interaction occurring in SLC classrooms based on an 
instrument called the Social Learning Interaction System (SLIS) and their 
relationship to the SLERS factor structure and the student outcome measures. 

Principal Investigators: Joyce P. Wars how 

Raymond A. Bepko 
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SECTION I: INTRODUCTION TO THE SOCIAL LEARNING ENVIRONMENT RATING SCALE 

Joyce P. Warshow and Raymond A. Bepko 

PURPOSE 

This monograph presents the theoretical rationale for and the development 
of the Social Learning Environment Rating Scale (Warshow & Bepko, 1974). The 
Social Learning Environment Rating Scale (SLERS) is:a classroom observation 
instrument designed to examine teacher-student behavior within the framework of ^ 
a large-scale curriculum for educable mentally handicapped (EMH) children, 
namely, the Social Learning Curriculum (Goldstein, 1974a). Most important, the 
paper examines the empirical quality of the SLERS with respect to its factor 
structure and ability to detect specific sources of variation - all of which have 
direct implications for the continued development and implementation of the Social 
Learning Curriculum (SLC). 

THEORETICAL RATIONALE FOR THE SLERS 
General 

An observational approach to the examination of the SLC appeared warranted 
because comparative data on student outcomes would be meaningless without 
' information on how, and under what circumstances, the SLC was implemented. 
Variation in the implementation of the SLC would certainly influence the results 
the program produces. Therefore, data regarding a program can be interpreted 
only vrfi thin -i;he context of Informati on at)OU t di fferences 1 n' impTementatton . 
Sjmply stated, the process of implementation will effect the results of a 
curriculum. Information regarding that process must be considered in an exami- 
nation of those results (Rosenshine, 1970; Rosenshine and Furst, 1973; 
Glennon, 1973). 
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The Social Learning Curriculum Is unique In the sense that It specifies 
a structure and teaching strategy by which the curriculum Is to be Implemented, 
The SLERS was developed to monitor this way of Implementating the curriculum. 
The analysis of this Information Is intended to provide a context for Inter- 
pretation of measures which examine the effect of the SLC on the performance of 
EMH students. Additionally, it was felt that classroom observation infomation 
would be useful to curriculum developers for revision purposes and would provide 
a framework "for teacher-supervisor interaction to optimize tne use of the SLC. 

Specific 

The Social Learning Curriculum is designed to provide a comprehensive and 
systematic framework in which the child learns to take responsibility for his 
actions through the development of "life skills" necessary to think critically 
and act independently in his home, family, neighborhood and community (Heiss and 
Mischio, 1972). Critical thinking (CT) is the ability to process information 
within the framework of a problem-solving strategy in a consistent, appropriate, 
effective and efficient manner. Independent Action (lA) is the application of 
that strategy without undue reliance on other persons. These are the major 
objectives of the SLC since both are viewed as necessary for the social adjustment 
and adaptation of the individual. 

Implementation of the SLC is based upon a Gestalt theory of learning applied 
to problem solving within the curriculum. It consists of three components: 
Mass, Differentiation, and Integration. The Mass is the emergence of a problem 
situation whose solution requires students to think critically. Differentiation 
Is the separation and analysis of the elements of the problem. During the 
course of this analysis the student makes judgments about the antecedents and 
consequences of the problem, formulates possible solutions, assesses the likeli- 
hood of their success, and tests the alternative solutions. Integration is the 
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reorganization of the elements of the problem situation and the incorporation 
of the knowledge gained during their analysis to abstract a rule or concept 
which may then be applied, independently of the teacher, in similar future 
situations. Through this process of implementation, student attainment of 
critical thinking and independent action is facilitated. It should be emphasized 
that Mass, Differentiation, and Integration, like critical thinking and independent 
action, are not completely separate and distinct. It is a dynamic rather than 
static process, with an inherent overlap between stages. 

Consistent with the overall M-D-I structure, the SLC prescribes the inductive 
strategy (Goldstein, 1974b). This method consists of the use of five-step 
hierarchical sequence of questions constituting the inductive teaching strategy 
(Greenberg and Smith, 1973). The stages in this hieraf^rhy as well as the teacher 
and pupil behaviors descriptive of the sequence are as follows: 

Labeling (Has) pupil:: name objects or elements of 

the problem. 

Detailing (Has)- pupils describe elements in the 

problem situation 

Inferring (Has) pupils make associati ons between ideas 

and events relevant to the problem and 
state possible solution. 

Predicting (Has) pupils articulate probable solutions 

to a problem, predict the consequences 

of each, solution, and try out the . . _ 

accepted solution. » 

Generalizing (Has) pupils apply concepts and skills 

learned in one problem-solving situation 
to a new but similar problem situation. 

The relationship bntween the M-D-I structure and an inductive teaching 
strategy is apparent in the above definition of induction and in the earlier 
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description of Mass, Differentiation, and Integration. The inductive teaching 
strategy was chosen since the primary target population of the SLC, EMH 
students, do not often possess the rules to guide their social behavior. 
Inductive problem solving allows them to formulate rules within the classroom 
environment and provides them with a strategy for dealing with problem situations 
outside the classroom. 

Figure 1 is a^ schematic representation of the SLC teaching process. It 
visually demonstrates the theoretical relationship between Mass, Differentiation,,^ 
Integration, critical thinking, independent action, and inductive teaching strategy 

Independent action refers to those theoretical aspects of the learning 
environment which facilitate the teacher's use of the curriculum and the student's 
ability to think critically and act independently. Both the implementation 
structure and the attainment of critical thinking and independent action objectives 
initially occur within the environment of the classroom. That environment is 
actually a confluence of physical, social, and psychological elements. 

The aspect related to the Mass stage in Figure 1 refers to the structuring 
of the physical environment to reflect pupil participation. Pupils are encouraged 
to move around the room- to obtain needed materials which should be easily 
accessible. 

There are two aspects related to the Differentiation stage. These are 
l-ndividuaT - processes ^nd group processes. In the f 1 rst , the teacher is aware of 
and accepts differences in pupils. She structures learning experiences to meet 
individual needs. Pupils are encouraged to share their own backgrounds and 
experiences. They are also encauraged to express feelings, explore spontaneous 
interests and make their own decisions wherever possible. The ultimate goal 
is that pupils experience competence and "self-worth." 
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Group processes refer to pupils working together to solve problems with 
the teacher serving first as an initiator .of learning and then as a resource. 
The focus in this environmental element is on pupil interaction as a 
contributor to the group problem-solving process. Here the actual solution 
to the problem is less important than the process. In addition, the 
teacher takes into consideration individual differences as they relate to 
constructive and supportive pupil interaction. 

The aspect related to the Integration stage has to do with structuring the 
environment to facilitate the application of a generalization or concept learned 
to a new situation with a minimum of assistance. The ultimate test of whether 
pupils can think critically and act independently is if generalizations learned 
in the classroom are transferred outside of the classroom and are maintained 
through adulthood. The likelihood of this occurring seems to be increased if it 
can be obsarved that the pupi"" behaviors associated with these constructs can be 
seen operating in the classroom. 

DEVELOPMENT OF THE SLERS 

Given these theoretical issues, it became apparent that an instrument 
designed for observing the SLC in action should encompass three related dimensions; 
a) the major objectives of critical thinking and independent action, b) the Mass - 
Differentiation - Integration structure of the SLC and the related inductive 
teaching methodology, and c) the classroom environment in which the curriculum 
would be used. Additionally, the individual teachers' management and under- 
standing of the curriculum had to be considered (e.g., pacing, use of additional 
materials, comprehension of specific objectives). 
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Construction of the SLERS occurred in several stages. The first stage 
involved the initial generation of teacher and student behaviors related to 
the inductive teaching strategy and the creation of a classroom environment 
that is supportive to the development of problem-solving ability. Several 
behaviors were also included to take into consideration the teacher's ability 
to adapt the curriculujri to the classroom. Five members of the staff of the 
Curriculum Research and Development Center served as judges in decision-making 
concerning the initial content validity of the behaviors. 

The next stage consisted of observations of several New York City classes 
which were field testing Function V of the SLC.^ 

The purposes of these observations were to verify the occurrence 
of the behaviors derived from the SLC teaching model and to identify 
additional behaviors which needed to be included. No actual data were collected. 
These behaviors were discussed with the classroom teachers to provide feedback to 
them and to gain additional ideas and information relevant to the construction 
of the scale. 

In the next stage, generated behaviors were translated into specific items. 
Items were written to meet two criteria: first, the behavior which they 
represented should be observable and, second, they should relate to at least 
one aspect of the model of implementation described previously. Rating criteria 
for each item considered both the frequency and quality of the observed behavior. 
Examples were written both to define the item and to provide a basis for rating 
the item. See Warshow and Bepko (1974) for further discussion. 



Function V deals with teaching students to "communicate effectively. 
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The items were then refined on the basis of further classroom observations. 
Some items were eliminated where there were redundancies. Additional items 
were added to take into consideration events observed in the classroom which 
typified the constructs in question. During this, stage, less facilitative 
work was done with teachers. This final phase was also employed by the SLERS 
developers to establish sufficient quality control in terms of inter-rater 
reliability and calibration to provide a basis for the training of the outside 
observers discussed in the next section of the monograph. 

A final selection of items was conducted to eliminate those items which 
represented behaviors both unlikely to> occur and not crucial to the model. 
The items were then organized into the pilot version of the Social Learning 
Environment Rating Scale. Items were organized around the major objectives of 
the SLC, critical thinking and independent action, and a third area, teacher 
use of the curriculum, to represent those behaviors which were deemed important 
to the adaptation of the curriculum to individual teachers and classrooms. 
This organizational mode was used because of its logical consistency, conceptual 
clarity, and relevance to the reality of classroom behaviors. 

DESCRIPTION OF THE SLERS 

The resulting version of the SLERS was a sixty-item instrument organized 
for convenience into a teacher subscale and a pupil subscale. There are some 
parallel items in each sD'bscale. Specifically, certain items regarding teaching 
behavior lead to a logical expectation of analagous pupil behavior. 

Each item is rated on a scale of 1 to 5, with 5 being the highest rating. 
A rating of 1 corresponds to "never," 2 = "rarely," 3 = "occasionally," 
4 = "frequently," and 5 = "almost never." Items are rated on the basis of 
the frequency and quality of the observed behavior. 

15 • ^ 



The SLERS items can essentially be characterized as "high inference" as 
opposed to "low inference" (Rosenshine, 1970). This decision was made in order 
to insure adevJi te content validity of the items in relation to SLC objectives 
despite the possibility of a sacrifice in the inter-rater reliability of the 
i terns . 

The teacher subscale is grouped into three sets: Critical Thinking, 
Independent Action, and Teacher Use (Management) of the Curriculum (see Table 1). 
Within the Critical Thinking and Independent Action sets, the items were organized 
into logical subsets, three for Critical Thinking and five for Independent Action. 

The assumptions underlying the CT dimension for teachers were that successful 
use of the inductive teaching strategy would facilitate critical thinking in 
pupils (Category C) (Goldstein, 1969, 1974). In addition, the teacher's awareness 
of the individual learning styles of pupils (Category A) and his focusing on the 
problem to be solved (the objective of the experience) (Category B) would enhance 
the possibility of the occurrence of critical thinking. 

There are five categories within the dimension of lA. Category A refers to 
the creation of a physical environment which encourages pupil participation. 
Category B takes into consideration social and psychological variables which may 
help or hinder problem-solving behavior. Category C takes into consideration 
the need for pupils to make judgments based on their own experience as a 
prerequisite for independent. action. Category D considers the fact that social 
learning takes place within a social context and that pupils can assist each 
other in solving problems providing there is a supportive environment. 
Category E refers to pupils solving problems interdependently and cooperatively 
based on previously learned concepts. The greatest opportunity for independent 
action occurs at this stage of an experience. 
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PILOT VERSION 

SOCIAL LEARNING ENVIRONMENT RATING SCAL E 
TEACHER SUBSCALE 

Critical Thinking (CT) 

A. Teacher is aware of individual differences . 

1. Acts upon differences in pupil learning style. 

B. Focuses on the objective of the experience . 

2. Understands objective (determined by what teacher does). 

a) Structures critical points in experience, rather than peripheral 
issues. 

b) Uses questions and activities that arrive at the objective 
determined by outline of what the teacher does. 

3- Teacher implements experience by focusing primarily on task 

rather than self. 

C. Uses the inductive problem-solving strategy . 

4. Presents problems or has problems emerge related to the objective. 
.5. Has pupils label appropriately. 

6. Assists pupils in separating relevant from irrelevant information 
with respect to the problem to be solved. 

7. Restructures or gives relevant cues so that pupils can rethink 
problem (pupil mediation). 

8. Provides opportunity for pupils to expand upon ideas. 

9. Provides opportunity for pupils to make associations between ideas. 

10. Allows time for reflection. 

11. Provides opportunity for pupils to articulate alternative solutions 
to a problem. 

12. Provides opportunity for pupils to predict consequences "of 
alternative solutions to a problem. 

13. Provides opportunity for pupils to try out solution(s) to a problem. 

14. Provides opportunity for pupils'to use -concepts and skills previously 
acquired in a new or different situation - with teacher help. 

17 ' ' 



TABLE 1 (continued) 

Independent Action (lA) 

A, Creates a physical environment that encourages and reflects pupil 
participation , 

15, Provides activity centers or grouping arrangements where children 
can work in small groups or on individual projects, 

16, Provides opportunity for different task-related activities to 
occur simultaneously, 

17, There is evidence of student-made material in the classroom, 

18, Allows ^pupils to move around room in nondisruptive activities, 

19, Allows pupil use of resources and materials in classroom, 

B, Takes into consideration inter- and intra-individual differences , 

20, Allows pupils to express negative feelings (e,g,, sadness, anger, 
frustration, and the like) that are not disruptive to the group, 

'21. Allows pupil expression of positive feelings (e.g., happiness, 
affection, pride) that are not disruptive to the group, 

22, Acts upon differences in pupil personality. 

C, Encourages pupils to use their own experience , 

23, Acknowledges spontaneous interests of pupils where appropriate, 

24, Draws on background and experiences of pupils, 

D, Encourages pupil interaction , 

25, Encourages pupils to be supportive of one another, 

26, Encourages constructive pupil interaction (task related), 

27, Asks one student to respond to another within a questioning 
strategy, 

28, Teacher is supportive of pupils (uses appropriate reinforcement). 

i 
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TABLE 1 (continued) 



Encourages pcipils to use the 'problem-solving strategy on their own . 

29. Provides opportunity for individual pupils to show that they have 
learned or understood something by solving a problem related to task. 

30. Provides opportunity for pupils to use concepts and skills previously 
acquired in a new or different situation - without teacher help. 

31. Allows pupils to make their own decisions wherever possible. 



Teacher Use (Management) of Curriculum (TC) 

32. Implements objective primarily through activities (rather than 
verbalization) which give the child the experience of the objective. 

33. Uses relevant additional activities to implement the objective 
of the experience. 

34. Uses relevant additional materials to implement the objective 
of the experience. 

35. Paraphrases within confines of objective rather than follows 
curriculum verbatim. 

36. Changes activity when pupils begin to exhibit inattentive 
behavior (pacing). 

37. Has pupils participate in distribution of materials (classroom 
management) . 
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Teacher use of the curriculum is a dimension that takes into consideration 
how the teacher manages the curriculum. Does she follow the script verbatim, 
or does she adapt it to the needs of her pupils by paraphrasing or making 
additions? 

Pupil subscale items were grouped into Critical Thinking and Independent 
. Action sets (see Table 2), Within the CI and lA sets, the items were organized 
into subsets analagous to those in the teacher subscale* 

Finally, Table 3 summarizes the breakdown of teacher and pupil items for 
each dimension and category. 

AREAS OF INVESTIGATION 

This monograph explores two separate, but related questions involving the 
SLERS. The first question deals with identifying and describing the primary 
qualities which define the instrument . In other words, what is the factor 
structure underlying the SLERS? Given the theoretical rationale behind the 
development of the instrument, two basic types of outcomes would appear reasonable. 
The first would suggest that the items would cluster around the dimensions of 
critical thinking (teacher and student), independent action (teacher and student), 
and teacher use of the curriculum. This finding would be consistent with the way 
the items are organized in the instrument itself. The second would suggest that 
the items should cluster around factors of Mass - Differentiation - Integration, 
each of which include some degree of critical thinking (teacher and student), 
independent action (teacher and student), and teacher use of the SLC. 

The second question concerns itself with an attempt to account for observed 
differences in t h ese primary qualities in terms of different classrooms and 
different SLC lessons . That is, what are the largest sources of variation 
between classes and among lessons. 

ER?C 20^ 



TABLE 2 

SOCIAL LEARNING ENVIRONMENT RATING SCALE 



PUPIL suBScALE 



Critical Thinking (C.T.) 

B. Focuses on the objective of the experience . 

38. Shows interest in the task and are generally attentive. 

C. Uses the inductive problem-solving strategy . 

39. Articulates probleni(s) related to the objective. 

40. Labels and details accurately. 

41. Mediates own responses. 

42. Expands on ideas. 

43. Makes associations among ideas. 

44. Shows evidence of reflecting before responding to a thought- 
provoking question or task. 

45. Articulates (infers) alternatTve solutions to a problem. 

46. Predicts consequences of alternative solutions to a problem. 

47. Tries out (verfies) solution(s) to a problem. 

48. Uses concepts and skills previously acquired in a new or different 
situation - with teacher help. 

Independent Action (I. A.) 

A. Creates a physical environment that encourages and reflects pupil 
participation . 

49. Makes use of activity centers independently or in groups. 

50. Works on different activities at the same time. 

51. Moves around room in nondisruptive activities. 

52. Uses resources and materials in the classroom. 
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TABLE 2 (Contined) 

B. Takes into consideration inter- and intra-individual differences , 

53. Expresses positive feelings. 

54. Expresses negative feelings. 

D. Encourages pupil interaction . 

55. Is supportive of others (provides assistance, does not ridicule). 

56. Interacts constructively with one another to solve a task-related 
problem. 

E. Encourages pupils to use problem-solving strategy on their own . 

57. Uses concepts and skills previously acquired in a new or different 
situation - without teacher help. 

58. Works independently to solve a problem. 

59. Participates in decision-making. 

60. Asks questions unsolicited by teachers. 
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TABLE 3 



TEACHER SUBSCALE 




PUPIL SUBSCALE 






TOTAL ITEMS 




TOTAL ITEMS 


Critical Thinkinq (CT) 




Critical Thinkinq (CT) 




A. Is aware of 

individual differences. 


1 




1 


Focuses on the objective 
of the experience. 


2 


B. Focuses on thp nhiprtivp 
of the experience. 




Uses the inductive 
problem-solving strategy. 


11 


C. Uses the inductive 

problem-solving strategy 


10 




14 Total 


11 Total 


Independent Action (lA) 




Independent Action (lA) 




A, Creates a physical envi- 
ronment that encourages 
and reflects pupil 
participation. 


5 


A. Participates in 

activity by free use of 
material add space. 


4 


B, Takes into consideration 
inter- and intra-indi- 
vidual differences. 


3 


B. Expresses individual 
differences. 


2 


C. Encourages pupils to use 
their own experience. 


2 






D. Encourages pupil inter- 
action. 


' 4 




O 
C 


E. Encourages pupils to use 
the problem-solving 
strategy on their own. 


3 


E. Uses the problem- 
solving strategy on their 
own. 


4 




17 Total 




\ C 1 U LCI 1 


Teacher Use (Management) of 
Curriculum 








Six items 


6 






Total Teacher Items 


37 


Total Pupil Items 


23 



23 



-10- 



A related question is concerned with the practical consequences of the 
sources of variation previously identified that would produce information 
relevant to the development, implementation, and revision of the SLC. That is, 
given certain absolute sources of differences, to what degree are the factors 
actually present in the lessons and to what degree are factors implemented in 
the classrooms? Is tt possible that certain factors (behaviors) are present 
to a greater degree in some classes or lessons while other behaviors are more 
prevelent in different classes or lessons? 
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SECTION II: PROCEDURES AND METHODOLOGY 
Raymond A. Bepko, Joyce P. Warshow. Gregory Schimoler and I. Leon Smith 

OBSERVER TRAINING 

Three observers were trained in the. use. of the SLERS for the purpose of 
data collection. The observers were graduate students in special education and 
educational psychology. All had some teaching experience. Training occurred 
over a four-month period and included the generation and discussion of examples 
for each SLERS item. The examples were taken from classroom observations made 
during the initial construction of the scale discussed in the preview section 
and during the actual observers' training. The trainees also rated existing 
audio and video tapes of teachers field testing various functions of the SLC. 
The major portion of the training consisted of actual classroom observations 
of the classes which were to participate in this study Thus, both the classes 
and the observers become familiar with each other. The observers were trained 
in the logistics of classroom research. Questions were resolved regarding 
approach to teachers, the kind of feedback information allowable, and interaction 
with students. A guideline for observers was prepared and weekly meetings were 
held to discuss issues which arose during the practice observations (see Table 4) 
A total of twenty-five practice observations were made. The discussions served 
to facilitate concurrence in assessing specific items. Initial quality control 
data was also generated in three different classrooms in order to provide an 
empirical basis for the training of the observers or judges. 

Table 5 contains the means, standards deviations, intercorrelations , and 
percentages of agreement among the three observer-judges (O-J-i; 0-J„; 0-J-) 

* Cm O 

and one of the SLERS Developers (D). 



The SLC lessons, however, were not the ones actually observed during the 
conduct of the study. :~; 
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Additional training was then undertaken in order to clarify discrepancies 
suggested by the analyses. These discrepancies were not unexpected, however, 
given the "high inference" nature of the instrument (Rosenshine, 1970). 

SAMPLE DESCRIPTION 

The sample consisted of seventeen intermediate-level EMR classrooms 
located in New York City. Classroom size varied from a minimum of seven to 
a maximum of fifteen and the students ranged in age from nine to fourteen. 
Seven of the classes had participated in the early stages in the development 
of the SLERS described in the previous section and/or the collection of quality 
control data for the purpose of training the observers. Ten additional classes 
were added in order to conduct the study related herein. All but two of the 
classes had participated previously in the field testing of various Phases and 
Functions of the SLC. 

DATA COLLECTION 

The seventeen classes were observed implementing six experiences (lessons) 
from Function VII (Emotional Security) of the SLC. These six experiences were 
chosen by the curriculum developers as representative of the total Function, 
which consisted of twenty-three experiences. The six observed experiences were 
written, like all SLC material, from a M-D-I model and included critical 
thinking and independent action objectives to be achieved in connection with 
the inductive teaching methodology. The three observers were assigned on a random 
basis to specific classes. Although randomization of observers was the goal, 
this could not be completely achieved because of logistical complications. A 
total of one hundred observations were made over a four-month period. See 
Figure 2 for a layout of "these observations. 

Er|c ■ 2G 



TABLE 4 



Guidelines for Observers 

1. Teacher and pupil ratings should be considered independently of each other. 
Teacher may cue without a response from pupil or pupil behavior my occur 
independent of teacher behavior. 

2. Ratings are based on what occurs during the period of SLC observation only. 

3. Ratings are scored on a scale of 1 to 5. Both quantity and quality of 
behavior are considered in the rating. 

4. Observers should be as unobtrusive as possible in the classroom. They 
should interact as little as possible with students. 

5. Observers are to follow school rules (e.g., signing a guest book, 
reporting to the office). 

6. Be prepared to provide feedback to teachers if requested, but not regarding 
specific SLERS items. 

7. Teachers should be notified in advance as to the date and time of 
observation, and to any recording equipment that may be used. 

8. Observers should be sufficiently fafrtiliar with the SLERS items se- that 
they may take notes keeping these items in mind. The rating scale should 
be filled out immediately after the observation. Ratings made after a 
24-hour period are invalid. 
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Figure 2 

Assignment of Observer-Judges by Class and Experience 



Experiences (Lessons) 





1 


2 


3 


4 


5 


6 


1 ' 


0-J^ 


O-J3 


O-J2 


O-J3 


O-J2 


O-J3 


2 


O-J3 


0-J^ 


0-J^ 


0-Ji 


0-J^ 


O-J3 


•3 


O-J3 


0-J^ 


0-J2 


0-J^ 


0-J^ 




4 


O-J3 


0-J3 


0-J3 


0-J3 


0-J2 


O-J2 


5 


Not . 
Observed 


0-J2 


0-J2 


0-J3 


0-J3 


O-J3 


6 




0-J, 


o-i3 


0-J^ 


0-J^ 


O-J2 


7 


0-J2 




0-J2 


0-J^ 


0-J3 


O-J3 


8 


O-J] 


0-J^ 


0-J3 


0-J2 


0-J2 




9 


O-J2 


0-J3 


0-J3 


0-J2 


0-J 

3 


O-J] 


10 


0-0^ 


0-J2 


0-J^ 


0-J2 


O-J3 




11 


0-J3 




0-J 

1 


0-J^ 


O-J3 


0-J2 


12 


0-J^ 


) O-Jj 


0-J3 


0-J3 


O-J2 


0-J^ 


13 


0-J2 


O-J3 


0-J^ 


0-J3 


O-J2 


0-J, 


14 


0-J3 


0-J^ 


0-J, 


0-J2 


O-J2 


0-J^ 


15 


0-J^ 


0-J2 


0-J2 


0-J3 




0-^1 


16 


0-J2 


0-J2 


0-J2 


0-J3 




0-J3 


17 


0-J2 


0-J^ 


"-'2 


0-J3 


0-J2 


Not 

Observed 



ERIC 



20 



-13- 

« 

During the observations, the 0-J's recorded information relevant- to each item. 
Immediately after each observation, the 0-J*s rated the teacher and pupils on 
each item. As an additional quality control check, one of the scale developers 
made three independent but concurrent observations with each of the three 0-J*s. 

Prior to the data collection, teachers were informed by letter that the 
purpose of the observations was to determine how different teachers implement 
the same curriculum materials. It was explained that this was necessary in 
order to provide feedback to curriculum writers for the revision of the materials 
and suggestions for future curriculum development. Teachers were asked to remind 
their students that visitors were coming to see how different classes were 
working with the curriculum and that there would be microphones to record what 
was happening. Reaction to the observers by the students was minimal since all 
of the classes had been observed prior to data collection by curriculum center 
staff. 

DATA ANALYSIS 

Factor Anslysis 
Unit of Analysis 

Since the implementation of the SLC is viewed as the interaction of the 
teacher, students and curriculum, the appropriate unit of analysis for this 
study was defined as the class. In other words, only a factor analysis of teacher 
and pupil behaviors together would yield evidence regarding the potential 
validity of the.SLERS and the accuracy of the SLC model of implementation, since 
both the instrument and the model assume an ongoing interaction between teacher 
and student. 
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Method of Analysis 

The factor structure of the SLERS was examined through the application of 
a principal components analysis, followed by varimax rotations (Veldman, 1967). 
The data for this anailysis consisted of the one hundred observations (classes x 
experiences as in Figure 2) across the sixty SLERS items. 

First, this data was used to compute the 60 x 60 inter-item correlation 
matrix (R). In the principal components stage of this analysis, the correlation 
matrix was used to extract, based on the least-squares criterion, f orthogonal 
(independent) principal components. Thus the first principal component 
extracted can be thought of as being a vector of item loadings which if 
multiplied by the matrix of item standard scores would result in a vector of 
factor scores accounting for the largest proportion of variance possible in 
the inter-item correlation matrix. The 2nd and 3rd ...fth principal components 
were similarly computed with the constraint that. they must be orthogonal 
(independent or uncorrelated) with the preceding principal components (s ) . For 
the purposes of this analysis the number of principal components extracted is 
determined by a joint criterion of the amount of variance the principal 
component accounts for and the degree of fit to the theoretical constructs 
assumed to underlie the SLERS. 

After the f principal components were extracted, these factors were rotated 
to simple structure using the varimax criterion. This procedure maximizes the 
variance in all f factors, such that the amount of variance attributed to each 
factor is as large as possible. In effect this rotation procedure minimizes 
the importance of the G-factor (1st principal component) by spreading the 
variance as equally as possible between the f factors. 
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At this stage some factor analysts (cf. Harmon, 1960) recommend oblique 
(correlated) rotations. The advantage of this procedure is that oblique 
factors are sometimes more readily interpretable since they may more accurately 
reflect the real-life situation where psychological constructs are indeed 
hypothesized to be correlated. However, allowing factors to be correlated 
presents two problems: 1) f oblique factors will always account for less of 
the total variance than f orthogonal factors, since there is redundant, common 
variance in each of the f factors, and 2) oblique factors are less stable than 
orthogonal factors. The use of oblique factors was decided against in this 
study since the factors were to be used in later analyses and it was desirable 
to retain the largest amount of the original variance in the fewest number of 
factors, and also because the sample size of one hundred was considered too 
small to risk a less stable solution which could prove difficult to replicate. 
Thus a varimax solution was considered to be the more appropriate procedure for 
this study. 

Finally, the varimax rotations produced a f factor x k item loading matrix. 
This matrix was used to interpret the meaning of the factors. To produce factor 
scores for each of the observations across the f factors, the varimax loading 
matrix was normalized to produce a varimax weights metrix. This is done simply 
to ensure that the resulting factor scores have a mean of 0 and, a standard 
deviation of 1. The factor scores are then generated according to the following 
formula: 

k 

S = E Z W 

ij k=l ik jk 



ERIC 



32 



-16- 



The factor score(s) for the Ith^ observation on the jth_ factor 1s the welghtisd (w) 
sum of the standard score (z) of the Ith^ observation on the kth^ltem. This 
procedure results In f factor scores for each of the one hundred observations. 

Components of Variance. Ap.a1.ys1s 

Specific sources of variation Inherent In the Instrument were Identified 
through the application of a components of variance analysis (Medley & Mitzel, 
1963; Cronbach et__al_. , In press; McGaw et__aT_. , 1973; Lindqulst, 1953), This 
procedure permits the simultaneous examination of many sources of the varia- 
bility employing an analysis of variance model. A general data layout for the 
design Is presented 1n Figure 3. An estimate of specific sources of variation 
or variance components in the design was obtained from a completely fixed, 
three-way (Classes x Lessons x Factors) analysis of variance (ANOVA) with one 
observation per cell. The model for the analysis was 

1^1 X.-H^n = "1 + C. + L. + F + CL.. + CF. + LF. + CLF.. + E.. 
ijmn 1 J m ij im jm ijm ijmn 

where m is a general mean, C^-, Lj, and F^ refer to the main dimensions of Classes, 
Lessons, and Factors, respectively, and E^j^^ is specific error. The third 
dimension in the design was based on the reduced set of factors (f) obtained 
from the previous analysis. That is, for each lesson, each class was assigned 
f factor scores based on weighted, linear combinations of the original items 
comprising the instrument. Both the original item scores and each of the f sets 
of factor weights were standardized before the linear combinations were 
calculated. The distributions (mean, standard deviation) of each of the f 
factors across lessons and classes were Identical, thereby artificially setting 
the source of variation due to factors alone at zero. The dimension had to be 
Included, however, in order to examine the sources of variation involving the 
interaction of the factors with both lessons and classes. 

<^ 33 
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In terns of partitioning the variance provided by the analysis, then, 
III A - Oc ^ + ^\ + + (^CF + ^LF + ^GLF * ^E- 

Since there was only one observation per cell, d^|_p + ^ estimated as 
^Ses- expected mean squares, based on fixed effects assumptions, are 
presented in Table 6, and estimates of each component are contained in Table 7. 

Implementation and Lesson Analysis 

, The sources of variation identified in the previous analyses were 
additionally examined in a way that would provide more direct information 
regarding the differential presence of the underlying factors in the lessons 
as well as the differential occurrence or implementation of the factors in the 
classes. This was accomplished by going back to the raw scores (1 = infrequently 
observed; 5 = frequently observed) for the specific item sets underlying each 
factor and computing their over-all mean for each of the classes and each of the 
lessons. A low. mean for items of a factor with respect to'the lessons would 
tend to indicate that the particular factor was infrequently present in the 
lesson, while a low mean for the items of a factor with respect to the classes 
would indicate that it occurs infrequently in the classes. 
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Figure 3 
Data Layout for the Design 



Factor C Classes^ i = 1, 2, ...17. 
Factor L Lessons j = 1 , 2, ...6. 
Factor F Factors m = 1 , 2, ...f. 




Table 6 
Expected Mean Squares 



Source of 
Variation 


E(MS) 


Classrooms - C 


(J| + 6f02 


Lessons - L 


v2 J? 
(5^ + 17f0[ 


Factors - F 




C X L 




C X F 


of + 6(j|f 


L X F 




Residual 


1 ^ «?LF 



3G 



Table 7 
Variance Components 





l/6f (MS. - MSo„) 
C Res' 


L 


1/175 (MS, - MSp^J 




1/102 (MSp - MS^gg) 




1/f (MS,^ - MS,^^) 




1/6 (MS^^ - MS,^^) 




1/17 (MS,^ - MS,^^) 


"Res 


MS_ 
Res 





Note - Estimates of the sources of variation based on the fixed effects 
model are very conservative, i.e. lower. bound estimates. That is, 
while none of the sources have O^ip (see Table 6) in their E(MS), 
the value for it is subtracted out anyway because it cannot be 
separated from 0| when there is one subject per cell. Thus, the 
components are to some degree "overcorrected" and underestimated. 
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SECTION III: A NALYSIS AND RESULTS 
Raymond A. Bepko, Joyce V. Warshow and Gregory Schimoler 

PRELIMINARY ANALYSES AND RELIABILITY CHECK 

" ^-y^ 

A preliminary analysis of the means and standard deviations of the 
SLERS revealed that two items (16 and 49) had a zero frequency of 
occurrence. These items were eliminated from the factor analysis resulting in 
an item pool of 58 rather than 60 items. 

During the course of the gathering of the data for this study, one of 
the SLERS developers went out three times with each of the three 0-J's to 
observe a class. A total of nine observations were made during the data 
collection period for the purpose of reliability check. Table 8 reports the 
intercorrelations between the 0-J and the SLERS developer for these nine 
observations. These correlations are comparable to those obtained during the 
0-J training period (see Table 5), indicating variable levels of reliability 
as well as some observer- judge bias for this high-inference measure. This 
effect is best illustrated in Table 5, where it was seen that despite a high 
level of agreement between the observer- judges on a given observation, the 
mean response for the three observer-judges differs somewhat. This implies 
that different observer-judges may be using different parts of the 1-5 rating 
scale to describe the same phenomenon. Thus, for e)jample, one observer-judge 
may mean the same thing by a rating of 4 as another observer- judge may mean 
by a rating of 3. 

This issue of observer bias is a crucial issue in the analysis of the 
SLERS since the one hundred observations were to be used as the unit of analysis. 
Approximately a third of the observations were done by each of the three 
observer-judges. If one of the 0-J's were a consistently high rater, another 
a consistently moderate rater, and another a consistently low .rater, simply 

£± 3« 



TABLE 8 



CORRELATIONS BETWEEN JUDGES AND DEVELOPER AT THREE TIMES FOR 
EACH OF THREE OBSERVATIONS WITH THREE OBSERVER- JUDGES (0-J) 





0-J 

1 


0-J 

2 


0~J 

3 , 


T 

1 


.600 


.699 


.799 


T 

2 


.766 

a 


.442 


.727 


T 


.688 


.665 


.524 



3 



ERIC 



39 



knowing who the rater was would to seme degree determine what the rating on 
a given observation for any given item would be. This 0-J bias effect would 
then also effect the inter-item correlations, and ultimately the factor 
analysis of the SLERS. 

In an effort to control for this 0-J bias, it was decided to standardize SLERS 
items within each of the three 0-J's. For each of the fifty eight items to be 
used to compute the inter-item correlation matrix, the mean and .standard 
deviation for each of the three 0-J's was computed and used to generate a new 
score standardized for any 0-J bias. Thus the new score for a given observation 
(i) made by 0-J (j) on a given item (k) may be expressed: 

^jk 

This results in a new data matrix standardized within 0-J's which is"- 
independent of any 0-J effect which might be present. This data matrix was 
then used to compute inter-item correlation for factor analysis. 

FACTOR ANALYSIS AND INTERPRETATION 

Standardized scores for fifty-eight SLERS items were factor analyzed 
according to the procedure previously described. Several solutions were 
computed, varying the number of factors extracted and rotated from two up to ten. 

One of the major purposes of this investigation was to determine whether 
actual class implementation of the Social Learning Curriculum was consonant with 
its theoretical rationale. It was felt that an examination of the factor 
structure of the SLERS would provide evidence regarding this issue. A five- 
factor solu-tion was arrived at as the optimal solution based on a relatively 
equal spread of the variance across the five factors and this solution's 
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compat1b1l1ty with the hypothetical model previously described. Logical 
Interpretation of this empirical data required the comparison of the factor 
solution with the theoretical model depicted schematically in Figure 1. This 
process Involved the resolution of several questions regarding the model, the 
original item classification, ,and the items defining each factor. 

Prior to the investigation, two general, alternative hypotheses were 
postulated regarding the predicted clustering of SLERS items into factors. 
One hypothesis predicted that items would cluster into categories and sub-, 
categories around the curriculum objectives of critical thinking and independent 
action and a third dimension, teacher use of the curriculum. The 
other possibility was that SLERS items would cluster into three dimensions 
representing the Mass, Differentiation, and Integration process prescribed for 
the implementation of the SLC. Both alternatives assumed that the inductive 
teaching method would be evident in the factor structure in the manner specified 
by Greenberg and Smith (1974) and discussed earlier in this monograph. 

The factor solution generated through the data analysis provided partial 
support for both hypotheses but did not Indicate that either alternative can 
be. fully accepted or rejected. 

Each of the five factors consisted primarily of items related to the 
critical thinking objective o£ the Independent action objective. There was 
little overlap of CT and lA related items on any individual factors. However, 
the items did not group into the CT and lA subcategories anticipated in the. 
organization of the scale (see Tables 1 and 2). There were three factors 
which could be considered related to critical thinking and two related to 
Independent action. Teacher use of curriculum did not appear as a separate 
factor. Furthermore, the two factors related to independent action qualita- 
tively differed. One of these reflected the concept. of Independent action as 
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originally defined, i.e., the items suggested that students were applying the 
problem-solving strategy independently of the teacher (although within situa- 
tions provided by her ). The independent action items defining the other 
factor refer to the physical, social and psychological aspects of the environ- 
ment. Therefore, the first 'hypothesis regarding the clustering of items around 
CT, lA, and TC dimensions, did not appear to be fully supported by the data. 
Additionally, the discrepancy between the two lA factors suggested that the 
original classification of items into CT, lA, and TC groupings needed to be 
reexamined. 

The second hypothesis predicted that the SLERS items would cluster into 
factors representing the Mass, Differentiation, and Integration stages and 
that the components of the CT and lA strategies would fall within these 
stages. Figure 1 (the SLC Teaching Process Flow), as described in the first 
section of the ajonograph, shows the theoretical relationship between Mass, 
Differentiation, and Integration and the teaching strategies designed to 
facilitate student attainment of critical thinking and independent action 
objectives. The obtained factor structure gives support to the conceptualiza- 
tion of problem solving as represented by Mass, Differentiation, and Integration. 
However, the five-factor solution, as well as the composition of the factors 
themselves, suggest the existence of a process more complex than the original 
conceptualization. It would appear that an additional, affectively-oriented 
dimension must be considered, particularly in light of the items which define 
Factor 3. 

The inductive teaching strategy is a five-step hierarchical sequence from 
labeling through generalization. With one significant exception, the items 
specific to the inductive strategy defined different factors in the expected 
sequential fashion. The exception occurred in the first factor. The appearance 
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of three prediction/verifi cation items, representing a later step in the 
strategy, with labeling and detailing items, representing earlier steps, 
presented a problem of interpretation. Therefore, the second hypothesis 
could not be fully supported. 

In summary, the interpretation of the factor structure had to resolve 
three basic issues: the definition of the factors viHh respect to critical 
thinking and independent action, the clarification of the M-D-I process, and 
the meaning of the appearance of items related to early and late steps of 
the inductive hierarchy on the same factor. " . 

i 

FACTOR STRUCTURE 

The five-factor solution and factor description of characteristic items 
is presented below. 
Factor 1^: Problem Emergence 

This factor is characterized primarily by critical thinking items (see-^ 
Table 9). The highest loading items represent the labeling and detailing steps 
of the inductive hierarchy. The teacher, from her understanding of the objective 
of the lesson, structures the lesson to focus the student's attention on the 
emerging problem. She has her students label the various parts of the problem 
and assists them in separating relevant from irrelevant information. The 
teacher acts upon differences in pupil learning style and encourages students 
to be supportive of one another. Students are generally attentive and interested 
in the task, label and detail appropriately and are supportive of one another. 

^Factors are presented in their logical order, not in the order of extraction. 
The order of extraction and percentage of variance accounted for was as follows: 
Factor One (12.62%), Factor Three (6.79%), Factor Five (10.08%), Factor Two 
(6.13%), and Factor Four (9.61%). The total percentage of variance accounted 
for was 45.23%. Factor identification was based on items with loadings in excess 
of .4. 
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1 

This factor depicts the teacher as a directive force, serving as an 
active guide, orienting students towards the problem within a structure 
designed to facilitate its emergence. Students do not play as active a role 
as the teacher (evidenced particularly by the negative load of item 57). The 
appearance of items 11, 12, and 44 in Factor 1 present a problem of interpre- 
tation. One would not expect the occurrence of prediction/verification items 
until mdch later in the problem-solving process and these items do not quite 
"fit'* the factor "picture" drawn in the preceding paragraph. A possible 
explanation for this phenomenon is that there must be an awareness that a problem 
exists before it can be solved. This awareness would logically occur as the 
problem itself emerges through the teacher's use of the full range of inductive 
questioning. From this viewpoint then, becoming aware of the existence of the 
problem is itself subject to an inductive problem-solving strategy. A second 
explanation for the Factor 1 appearance of prediction/verification items fo(;uses 
on teachers' tendencies to review the previous lesson at the beginning of a new 
lesson. It is likely that in the course of this review the teacher and/or 
students would focus on alternative solution(s) to that lesson's problem(s). 

Factor 2: Problem Clarification 

This factor is also characterized prfmariTy by critical thinking items 
depicting the part of the teaching-learning transaction dealing with the analysis 
and clarification of the problem (see Table 10). The teacher's relevant cueing 
and utilization of the students' experience provides the stimulus for students 
to further analyze the problem components. She gives students the opportunity 
and the cues to make inferences and to expand upon their ideas. Students 
identify relevant problems, make inferences, and mediate their own responses. 
Factor 2 also reflects student expression of negative feelings. (Expression of 
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Table 9 
Factor 1: Problem Emergence 



Teacher Student 



Item Number Loading Item Number Loading 

6 .67 39 .65 

3 -63 44 ,58 
2 .59 57 -.46 

4 .58 - 54 .45 

5 .57 37 .44 



11 .56 
1 .53 

34 .50 

24 .46 

12 .41 
9 .41 



Factor 1 Items 



Teacher 



5. Assists pupils in separating relevant from irrelevant information with (CT) 
respect to the problem to be solved. 

3. Implerrfints experience by focusing primarily on task rather than self. (CT) 
2. Understands objective (determined by what teacher does); 

a) Structures critical points in experience rather than (CT) 
peripheral issues. 

b) Uses questions and activities that arrive at the objective. 

4. Presents problems or has problems emerge related to the objective. (CT) 

5. Has pupils label appropriately. (CT) 

11. Provides opportunity for pupils to articulate alternative solutions (CT) 

to a problem. 

1. Acts upon differences in pupil learning style. (CT) 
34. Paraphrases within confines of objective rather than follows curriculum 

verbatim. (JC) 
24.. Encourages pupils to be supportive of one another. (lA) 

12. Provides opportunity for pupils to predict consequences of alternative 

solutions to a problem. (CT) 
9. Provides opportunity for pupils to make associations among ideas. (CT) 

Students 

39. Label and detail appropriately. (Cj) 
44. Articulate alternative solutions to a problem. (CT) 
57. Participate in decision-making. (lA) 
54, Are supportive of one another. (lA) 
37. Show interest in task and are generally attentive. (CT]_ 

^^te:- CT and lA refer to critical thinking and independent action. 
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posltive feelings also contributed to this factor, but at a loading less than 
the .40 criterion.) This item is the only independent action related item 
appearing in Factor 2. Its occurrence here may indicate the importance of pupil 
expression of affect during the problem clarification stage. 

Factor 3: Problem Resolution 

This factor is also defined primarily by Items related to critical thinking 
(see Table 11). The teacher provides students with the opportunity to articulate 
alternative solutions to the problem, explore their possible consequences, and 
verify the solution which they predict will work. The students, working 
together, abstract a rule or concept which is then applied, with the aid of the 
teacher, to a new problem situation. 

Factor 3 reflects the final steps In the Inductive sequence leading to the 
generalization by students of rules which may be applied to similar problem 
situations. The teacher still directly facilitates the learning while students 
are beginning to play a more active role in the process as the original problem 
is resolved. 

In fact. Factor 3 Items are distinguishable from the items related to the 
next factor, application of learning, in that the former relate to the student 
In a respondent role, while the latter refer to the student in a more operant 
role. The term, respondent. Is used here to Indicate that classroom activity Is 
primarily under the control of the teacher, while, operant, describes classroom 
activity at least partially under the control of the students. That Is, In 
Factor 3 the student "responds" more under the supervision of the teacher, while 
in Factor 4, the student "operates" more independently. In the respondent mode, 
questions and activl tits provided by the teacher are responded to by the student 
and/or the class as a whole. The teacher Is more actively Involved In directing 
activities In which a generalization is applied by pupils. Factor 4 items, 
ERJC °" characterized by a more operant mode of 4G 



Table 10 

Factor 2j Problem Clarification 



Teacher 




Student 


_ 


Item Number 


Loading 


Item Number 


Loading 


9 


.57 


42 


.63 


23 


.57 


38 


.49 


7 


.49 


40 


.42 


8 


.45 


53 


.42 


5 , ^ 


.42 







Factor 2 Items 

Teacher 

9. Provides opportunity for pupils to make associations between , (CT) 

ideas. | 
23. Draws on background and experiences of pupils. I (CT) 

7. Restructures or gives relevant cues so that pupils can 

rethink problem (pupil mediation). (CT) 

8. Provides opportunity for pupils to expand upon ideas. (CT) 
5. Has pupils label appropriately. (CT) 

Students 

42. Make associations among ideas. (CT) 

38. Articulate problems related to the objective. (CT) 

40. Mediate own responses. (CT) 

53. Express negative feelings. (lA) 



Note: - CT and lA refer to critical thinking and independent action respectively. 
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Table 11 

Problem Resol uti on 



Teacher 



Student 



item Number 

14 
13 
12 
31 



Loading 

.66 
.64 
.61 
.45 



Item Number 

47 
46 
45 
' 55 



Loading 

.66 
.65 
.57 
.47 



Factor 3 Items 



Teacher 



14. Provides opportunity for pupils to use concepts and (CT) 
skills previously acquired in a new or different situation - 
with teacher help. 

13. Provides opportunity for pupils to try out solutions to a (CT) 
problem. 

12. Provides opportunity for pupils to predict consequences of (CT) 
alternative solutions to a problem. 

31. Implements objective primarily through activities (rather than (TC) 
verbalization) that give the child the experience of the 
objective. . „ 

r 

students 

47. Use concepts and. skills previously acquired in a new or (CT) 

different situation - with teacher help. 
46. Try out solutions to a problem. (CT) 
45. Predict consequences of alternative solutions to a problem. (CT) 
55. Interact constructively to solve a task related problem. (lA) 



Note: - CT and lA refer to critical thinking and independent action. 
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Table 12 






Factor 4: Application of Learning 






Teacher Student 




Item Number Loading Item Number 


Loading 


28 


• / O 00 


.74 




1^ AO 


.68 




• Do 0 1 


.68 


18 




.56 




. M-O ^ OU 


.44 


oc 


. H'O 




1 7 
1 / 








ractor H items 




1 Ca IC 1 






28. 


Provides opportunity for individual pupils to show that they have 


(lA) 




learned or understood something by solving a problem related 






to the task. 




36 


nab pupils participate in uistriDutlon ot materials 


(TO 




V v« 1 ab o rumif niariaycnicf 1 1 y . 




9Q 


rroviaes opportunity tor pupi is to use concepts and ski I is 


(lA) 




previously acquired in a new or diTTerent situation - witnout 






tCaLi IC 1 lie 1 p . 




18. 


Allows pupil use of resources and materials in the classroom. 


(lA) 


33. 


Uses relevant additional materials to implement the objective of 


32. 


^riA A\/nAv«nAn^A 

tne experience. 


(TC) 


Uses relevant additional activities to implement the objective of 




the experience. 


(TC) 


17. 


Allows pupils to move around room in nondisruptive activities. 


(lA) 


Students 


♦ 




56. 


Work independently in solving a problem. 


(lA) 




Use concepts and skills previously acquired in a new or 






different situation - without teacher help. 


(lA) 


51. 


Use resources and materials in the classroom. 


(lA) 


49. 


Make use of activity centers independently or in groups. 


(lA) 


50. 


Move around room in nondisruptive situations. 


(lA) 


Note: - 


CT and lA refer to critical thinking and independent action. 




O 


49 




ERLC 







-25- 



instructlon, where the environment is arranged in such a way that pupils apply 
a problem-solving strategy with a greater degree of independence. The 
difference between Factor 3 and Factor 4 items then, is not that one is more 
verbal and the other more active. On the contrary, one of the items in Factor 
3 indicates that the teacher implements the objective primarily through activities 
rather than through verbalization. In this way pupils gain the experience which 
is preparatory to his functioning within the operant mode (see Factor 4 below). 

Factor 4: Application of Learning 

This factor is characterized by items relating to independent action as 
originally defined, i.e., the application of a problem-solving strategy without 
undue reliance on others (see Table 12). 

The teacher encourages student participation and independent use of the 
problem-solving strategy by providing additional relevant activities and 
materials, giving individuals the opportunity to demonstrate their new learning 
by solving a task related problem, and allowing students to use the full 
resources and materials of the classroom. 

Students demonstrate the problem-solving strategy by working independently, 
utilizing classroom resources, activity centers, and materials, and applying 
the concepts and skijls previously generalized to new problem situations. The 
full participation of students in the teaching-learning process is reflected 
in Factor 4. This factor is probably the best predictor of the ability to 
generalize social learning skills from the SLC to functioning in other 
situations, or in adult life. The child must apply a generalization understood 
from specific content within a lesson, demonstrate that he can use a problem- 
solving strategy on his own, and use the resources available to him. 
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Factdr 5: The Social Learning EnvirongTient 

This factor (see Table 13) is defined by items originally classified as 
related primarily to independent action. However, these items, as mentioned 
earlier, appear to be qualitatively different from the independent action items 
in Factor 4. Factor 5 is Indicative of an affective environment. It depicts 
a background In which the problem-solving process and application of learning 
reflected In the other factors. Is facilitated. 

Essentially, the teacher arranges and manages the physical, social and 
psychological aspects of the environment. There is freedom of movement within 
the classroom and pupils participate in decision making. 

The teacher creates a psychological environment which reflects a respect 
for individual differences, Interests, ideas, and feelings, and encourages 
pupils to be supportive of each other. This supportlveness sets the tone for 
. constructive pupil Interaction. 

When the teacher implements the objective primarily through activities 
rather than through verbalizations, she Is reflecting the position that pupils 
should be encouraged to trust their own experiences and to learn from them. 
That pupils are encouraged to Interact to solve a problem reflects the assumption 
on the part of the teacher that pupils can learn from each other. 

This Is further demonstrated when the teacher asks one student to respond 
to another within a questioning strategy. 

It should be noted that the two highest loading items on Factor 5 reflect 
the expression of emotion. It is not known to what extent this is content 
specific, given the focus on emotional security in the SLC Function in use at 
the time this^data was collected. However, the definition of this factor by 
affective items (other than those dealing specifically with the expression of 
feelings) would tend to indicate that the social learning environment would be 
a factor in the implementation of all SLC materials. 
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SUMMARY OF FACTOR ANALYSIS' 

An examination of the factors generally supports the conceptualization 
of the Mass, Differentiation, Integration flow originally depicted in Figure 1. 
However, the process is further clarified by these factors, as indicated in 
Figure 4. Factor 1, Problem Emergence, corresponds to the Mass stage. Factors 
2 and 3, Problem Clarification and Problem Resolution, represent the Differ- 
entiation stage. Factor 4, Application of Learning, reflects the Integration 
stage. Student critical thinking and independent action, and the teaching 
behaviors which facilitate CT and lA are no longer considered separately. They 
are conceptualized as part of a gestalt which occurs within an enabling 
environment. Furthermore, student behavior is seen as moving from a respondent 
to an operant mode. In the respondent mode, the teacher is relatively more 
dominant in directing the learning activities. In the^'operant mode students are 
independent of the teacher in the sense that they can apply what they have 
learned without her direct guidance. The problem-solving process reflected 
in Factors 1, 2, 3 and 4 and facilitated in Factor 5 depicts the teacher 
gradually relinquishing direct control and the students assuming a more active 
role in their own learning. 

What emerges from Figure 4 is a notion of teacher-learner transactions 
inherent in both the process and content of the Social Learning Curriculum. 
The teacher is involved in the learning process as a manager, director, or 
resource person according to the needs of her students and the demands of the 
curriculum. The nature of these transactions will change as the students gain 
skill and confidence. The general educational goal of these transactions is 
always the cognitive and affective Independence of the students as they interact 
with others in social situations. 
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Table 13 








Factor The Social Learning Environment 




Teacher 




oLuaent 




Item Number 


1 nadina 


Ttpm N[jmhpr 


Loading 


19 


.67 


50 


.57 


20 


.62 


55 


.57 


17 


.58 


52 


,56 


25 


.58 


53 


.54 


24 


.53 


54 


,54 


30 


. 52 


57 


,46 


21 


.52 


41 


,42 


22 


.47 






CO 


.42 






31 


.40 







Factor 5 Items 

Teacher 



19, Allows pupils to express negative feelings, (lA) 

20, Allows pupil expression of positive feeling, (lA) 
17, Allows pupils to move around room in non-disruptive activities, (lA) 

25, Encourages constructive pupil interaction, (lA) 
24, Encourages pupils to be supportive of one another, (lA) 

30, Allows pupils to make their own decisions wherever possible. (lA) 

21, Acts on differences in pupil personality, ' (lA) 

22, Acknowledges spontaneous interests of pupils where appropriate, (lA) 

26, Asks one student to respond to another within a questioning 

strategy, (lA) 

31, Implements objectives primarily through activities (rather than 

verbalization) which give the child the experience of the 

objective, (TC) 

Students 

50, Move around room in non-disruptive situations, (lA) 

55, Interact constructively to solve a task related problem, (lA) 

52, Express-positive feelings. (lA) 

53, Express negative feelings, (lA) 

54, Are supportive of one another (IA| 
57, Participate in decision making. (lA) 
41, Expand on ideas, (CT) 



ERsiO " ^'^ refer to critical thinking and independent action, 
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The Interrelationship of critical thinking and independent action, 
cognition and affect, within the social learning environment is apparent 
throughout the teaching-learning process. The general trend through the 
factprs is towards student competence and autonomy outside of the classroom. 
This is represented by the box labeled Transfer in Figure 4. 

The five-factor solution depicted within Figure 4, then, represents 
the empirical validation of an expanded version of the M-D-I model presented 
earlier in this monograph. It suggests that teacher-student behaviors, 
directed towards critical thinking and independent action, can be viewed within 
the framework of a social learning environment which facilitates the use of a 
problem-solving process oriented towards the application of an inductive style 
of reasoning. The model, in sum, represents the desired process of imple- 
mentation for the Social Learning Curriculum. The implications of this factor 
structure will be discussed in a later section. 

^COMPONENTS OF VARIANCE ANALYSIS 

' Table 14 contains an estimate of the specific sources of variation obtained 
from the completely fixed, three-way (Classes x Lessons x Factors) ANOVA. 
The dimension of factor was that obtained'^ rom the previously described factor 
analysis. 

The results suggest that it is not meaningful to look at differences in 
classes and lessons £er se_ as important contributors to variation on the 
SLERS. Neither does it appear valuable to look at the interaction of classes 
and lessons. Perhaps this is because a "lesson" as an entity is too global 
a way of making comparisons and identifying differences, in addition, it is 
possible that the SLERS as a total instrument is not sensitive to differences 
in what the lessons contain or the way they are implemented in the classes. 



However, when specific factors underlying the SLERS are considered, both 
classed and lessons can be differentiated. Most notably, it appears that 
the factors underlying the SLERS are differentially present in the lessons. 
In addition, it appears that the five factors underlying the SLERS are 
differentially implemented in the classes as. well. 

In order to clarify which specific factors were involved, additional 
two-way (Classes x Lesson) components of variance analyses were conducted for 
each SLERS factor. 

Table 15 contains the variance estimates for classes and lessons for 
each of the five factors underlying the SLERS. These results clearly suggest 
that the classes can be most highly differentiated on the fifth factor, the 
social learning environment, and to some degree on Factor 1, Problem Emergence, 
and Factor 4, Application of Learning. That is, the classes differ most on the 
degree to which they establish an environment consistent with the M-D-I model 
as well as the degree to which they deal with problem emergence and application 
of learning behaviors. The six lessons, on the other hand, appear to differ 
the most on Factor 3, the problem resolution phase within the M-D-I structure. 

IMPLEMENTATION AND LESSON ANALYSIS 

Additional analyses were conducted in order to provide more direct informa- 
tion concerning the differential presence of the problem resolution factor 
in the lessons as well as the differential occurrence or implementation of the 
social learning environment, problem emergence and application factors In the 
classes. Table 16 contains the overall means for the item sets underlying 
each factor computed for each lesson (1 = Infrequently occurring; 5 = frequently 
occurring). A more complete discussion of this procedure Is presented in the 
previous section. 
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TABLE 16 



Raw Score Means for Item Sets 
Underlying Each factor for Each Lesson 



Lessons 



Problem 
Emergence 



Problem 
Clarification 



Problem 
Resolution 



Applica- 
tion of 
Learning 



Social 
Learning 
Environ- 
ment 



Lesson One 


2.6 


2.9- 


1.9 


1.9 


3.1 


Lesson Two 


3.4 


3.0 


1.6 


1.4 


2.6 


Lesson Three 


3.2 


2.9 


2.8 


1.4 


2.6 


Lesson Four 


3,5 


3.2 


2.2 


1.8 


2.6 


Lesson Five 


3.4 


3,3 


2.7 


2.1 


2.8 


Lesson Six 


3.7 


2.9 


2.5 


1.2 


2.7 


Overall Factor Mean 


3.3 


2.9 


2.5 


1.6 


2.7 



NOTE: A value close to one indicates that the factor was present in the 
lesson infrequently. A value close to five indicates that the 
factor was frequently present in the lesson. 



ERIC 



50 



-30- 



The results indicate that the differential presence of the problem 
resolution factor is primarily associated with lessons one, two, three, and 
five. That is, the factor is least present in the first two lessons and most 
present in the 3rd and 5th lessons. This factor, as indicated earlier, 
represents the final steps in the inductive sequence and the last stage in*' 
the problem-solving process, just prior to the application of learning. The 
Social Learning Curriculum is organized generally within the framework of Mass, 
Differentiation, and Integration. Early lessons within a Phase represent the 
Mass stage, corresponding to Factor 1, Problem Emergence. Later lessons 
represent the Differentiation and Integration stages, corresponding to Factors 
3 and 4, Problem Resolution and Application of Learning. An examination of 
the means for Factor 3 indicates the lowest scores occur on early lessons and 
the highest on later lessons. Therefore, the range and trend of the means for 
this Factor 3 appear consonant with the organization of the SLC. Earlier 
lessons are least conducive to problem resolutions; later lessons are more 
conducive. 

Table 17 contains the overall raw score (1 = infrequently occurring; 
5 = frequently occurring) means for the item sets underlying each factor 
computed by class. Again, see the previous section for a more complete dis- 
cussion of this procedure. 

These results confirm that the behaviors underlying the factors of the 
SLERS vary in the degrees to which they occur or are implemented in the classes. 
For example, on the Social Learning Environment factor, class 12 represents 
a "high" implementor, while.^c.lass 4 is a "low" implementor. Behaviors 
associated with Factor 1, Problem Emergence, also occur to a much greater degree 
in class 12 than say classes 5 and 10. Finally, on Factor 4, Application 
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of Learning, class 14 appears to be a "high" implementor while class 1 
is a "Tow" implementor. 5 ■ 

A partial explanation of the role of the SLE factor in differentiating 
the classes is suggested by the fact that it is the least specified part of 
the Social Learning Curriculum. Although a general atmosphere of acceptance 
and responsiveness is encouraged, instructions analogous to the detailed 
description of the inductive questioning sequence are not provided with regard 
to the class environment. It is not surp,rising, therefore, that this least 
specified factor most differentiated the classes. 

The additional overall factor comparisons also indicate quite strongly 
that Factor 1 behaviors, associated with Problem Emergence, were observed 
most frequently in lessons and classes while behaviors associated with Factor 4, 
Application of Learning, were observed least frequently. 

This indicates a trend towards greater presence and occurrence of early 
factors and lesser presence and occurrence of later factors within the model 
described in Figure 4. The factors in descending strength are: Factor 1, 
Problem Emergence; Factor 2, Problem Clarification; Factor 5, the Social 
Learning Environment; Factor 3, Problem Resolution; and. Factor 4, Application 
of Learning. Essentially, the least difficult dimensions within the problem- 
solving process appear frequently, the most difficult appear infrequently - 
not an unexpected event. The implications of these results for the Social 
Learning CurricuTum and the trai-ning of teachers to use the SLC will be 
discussed at length in a subsequent section of this monograph. 



5 The relationship between class differences on these factors and class/ 
5 student outcome data will be examined in the second monograph. 
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SECTION IV: DISCUSSION. CONCLUSION. AND IMPLICATIONS 
Joyce P. Warshow. Raymond A. Bepko and I. Leon Smith 

SUMMARY OF RESULTS 

The principal findings of this study are as follows: 

1. The Factor Structure underlying the Social Learning Environment Rating 
Scale (SLERS) generally validated the theoretical foundation of the Social 
Learning Curriculum from which it was developed. 

2. Classes differed the most on behaviors associated with the Social Learning 
Environment factor, and to some degree, the Problem Emergence and Application 
of Learning factors. 

3. The six lessons of Function VIII of the Social Learning Curriculum differed 
in the degree to which the behaviors associated with the Problem Resolution 
factor were present. This factor is less present in the early lessons and 
more present in later lessons. 

4. Overall factor comparisons indicate quite strongly that behaviors associated 
with Factor 1. Problem Emergence occurred most frequently while behaviors 
associated with Factor 4. Application of Learning, occurred least frequently. 

VALIDATION OF THEORY 

Theoretically, the Social Learning Curriculum specifies an inductive 
teaching method within a Mass-Differentiation-Integration structure. To what 
degree are these theoretical components a classroom reality? The results of 
this study suggest that the implementation of the curriculum is characterized 
by a problem-solving process and a social, learning environment (SLE) within 
which that process unfolds. The process consists of four factors or stages: 
Problem Emergence, Problem Clarification. Problem Resolution, and Application 
of Learning. The steps of the inductive teaching strategy occur within these 
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four stages. The SLE can be viewed as the psychological, social and, to an 
extent, physical background which facilitates student attainment of the major 
curriculum objectives: critical thinking and independent action. 

The inductive teaching strategy specified by the Social Learning Curriculum 
is apparent in but not synonomous with the factors which comprise the problem- 
solving process. The factors themselves can be viewed within the M-D-I 
structure. The Mass is represented by Factor 1, Problem Emergence. Differenti- 
ation is characterized by Problem Clarification and Problem Resolution. 
Integration is apparent in Factor 4, the Application of Learning. 

Essentially, the factor structure would appear to validate the basic 
theoretical foundations of the Social Learning Curriculum. It also suggests 
the need to examine with greater care the environment in which the curriculum 
is used. Four distinct stages of the problem-solving process have been 
identified. These four stages have been further defined by the items which 
comprise the factors. An examination of the factors depicts a teaching/ 
learning transaction in which the teacher and students play equally important 
roles. These roles change as students gain confidence and competence. 
Students initially respond to the direction and guidance of the teacher and 
eventually operate with a greater degree of independence. 

Data collection was based on the teaching of six lessons from a unit 
(Function VII) that deals with the identification and expression of emotions. 
While this Function is representative of other Social Learning Curriculum 
Functions in terms of the M-D-I structure's problem-solving process and the 
inductive teaching strategy, the content deals more with affective learning 
than does the content of other Functions. This raises the question as to the 
effect of differences in curriculum content on the factor structure of the 
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SLERS as well as on teacher implementation. Specifically, the appearance of 
an affectively oriented factor (The Social Learning Environment) might be 
due, in part, to the affective content of the curriculum. As stated previously, 
however, the appearance of affective items other than those dealing specifically 
with emotional expression supported the notion that an SLE factor would occur 
regardless of the specific curricular content. This hypothesis also seems 
" reasonable in view of the developmental stages of the SLERS, The reader will 
recall that the SLERS was developed over three SLC units. Function V dealt 
with Communication Skills, and Function VI dealt with utilization and categori- 
zation while only Function VII dealt with emotions. , Nevertheless j'^Turther 
Investigation appears warranted and any replication of this study should 
specifically deal with the potential effect of different lesson content on the 
factor structure of the SLERS. 

The appearance of prediction/verification items in the Problem Emergence 
factor suggests the possibility of a two-dimensional Mass stage. The first 
dimension requires the recognition by students that a problem does indeed exist. 
Only after problem recognition occurs can the problem itself be resolved. This 
issue carries with it certain implication for further development and revision 
of the curriculum which are discussed below. 

The appearance of the prediction/verlfi cation items in Factor 1 also 
emphasizes the distinction between the problem-solving process and the Inductive 
teaching strategy. The process itself consists of the four factors (stages) 
previously identified. The steps of the inductive teaching strategy - 
labeling through generalization - occur at various points within this process, 
but do not depend completely on any one of the four factors. 
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CURRICULUM DEVELOPMENT AND REVISION 

This study revealed wide variation in the use of the Social Learning 
Curriculum. The sources of this variation rest with individual classes and 
the lessons of the SLC itself. The results strongly suggest the need to 
strengthen both the problem-solving process and the M-D-I structure within the 
written curriculum. 

Of the five factors, Problem Resolution and Application of Learning showed 
the least Implementation within classes. Problem Emergence and Problem 
Clarification showed the greatest strength. The most variation within classes 
appeared on the Social Learning Environment factor. Classes also varied 
significantly with respect to Problem Emergence and Application of Learning. 
The six SLC lessons differed the most on Factor 3, Problem Resolution. 

When a given factor shows a high degree of occurrence within classes It 
is reasonable that It both appears in the written lesson and is implemented 
by the teacher. When the factor does not occur, there are at least two alter- 
native explanations. 

The first alternative is that the particular SLC lesson(s) in use Is (are) 
not written In a manner conducive to the factor's occurrence. This may account 
for the differences among lessons on the Problem Resolution factor and the 
variation within classes on the Social Learning Enviroonment factor. Within the 
M-D-I structure of the Social Learning Curriculum, the early lessons in a 
Function are not written to elicit problem solutions. Therefore, the presence 
of the Problem Resolution factor would not be expected In these lessons. ;. 
As Indicated in a previous section of this monograph, the construction of a 
classroom environment facilitative of critical thinking and independent action 
1s not described in detail in the lessons cf the SLC. Since the curriculum 
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provides the least information on the implementation of the Social Learning 
Environment it is not surprising that classes vary the most on this factor. 

The second alternative explanation for the non-occurrence (or weak 
presence) of a factor focuses on the teacher* s role in the use of the !SLC. 
The teacher may not understand the M-D-I structure, the problem-solving pro- 
cess, or the steps of the inductive teaching strategy. The teacher may under- 
stand this structure, process, and strategy but experience difficulty in 
making the translation from cognitive awareness to actual teaching behaviors. 
For example, the teacher may have difficulty enabling students to generalize 
what they have learned from the resolution of a problem to a new situation, 
thus resulting in low implementation of Factor 4, Application of Learning. 
Finally, --the premises which underlie SLC implementation may be inimical to the 
teacher's own view of ."good teaching." The teacher may, for example, be more 
comfortable with a didactic approach wherein the teacher is the sole provider 
of information and students do not play as active a role in the acquisition and 
utilization of knowledge. A teacher with this perspective would not be likely 
to exhibit the behaviors which are the basis of the Problem Resolution and 
Application of Learning factors. However, if the teacher accepts the premise 
that students can learn from "incorrect" as well as "correct" responses, he/she 
is more likely to provide activities where students can explore alternative 
solutions, resolve conflict situations, and act independently. This second 
alternative explanation has implications for teacher training which are dis- 
cussed later in this monograph. 

Given the pattern of variation and strength of occurrence both within 
classes and across lessons, a number of recommendations to Social Learning 
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CuHriculum developers would seem reasonable. The factor structure itself, 
particularly the two-dimensional Mass stage also suggests certain areas of con- 
cern for the curriculum developers. These areas focus on information to the 
developers concerning the written SLC only. In fact, a specific feedback 
questionnaire was constructed in order to provide curriculum developers with 
the data and findings obtained through the use of the SLERS. A copy of this 
questionnaire appears in the Appendix. 

Given the relatively low degree of occurrence of factors 3 and 4, 
teachers appear to need greater information regarding the problem resolution 
and application of learning stages of the problem-solving process. Therefore, 
in the revision and development of curriculum materials, the writers would do 
well to focus on these two stages, emphasizing in the information provided to 
teachers both the necessity and techniques required to facilitate behaviors 
associated with the Problem Resolution and Application of Learning factors. 

Based on the finding that the Problem Resolution and Application of 
Learning factors were not implemented as strongly as the Problem Emergence and 
Problem Clarification factors, the following specific suggestions are made: 

1) Several qil^rnative activities should be written into the lessons 
which provide students with more opportunities to arrive at generalizations. 

2) The stages of the problem-solving process and steps of the inductive 
teaching strategy might be stated as lesson objectives or mini-objectives. 

3) The importance of having pupils explore options and try out alterna- 
tive problem solutions should be given greater emphasis.* 

4) Generally, activities within a lesson should be labeled with regard 
to the stages of the problem-solving process. Teachers might then have a better 
notion of where Problem Resolution and Application of Learning fit into the 
continuum of the teaching-learning process. 
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Based on the findings that little provision is made for independent 
activity or application of learning, on the part of teachers, the following 
suggestions for curriculum revision and future development are made: 

1) There should be more independent activities specified so that 
solutions arrived at in the respondent situation might be generalized to new 
but similar problems. This will help the student to process what he has ex- 
perienced. 

2) Additional activities which make possible the application of 
learning--without the teacher's guidance--should be provided. This would hope- 
fully result in an increase in the students' independent actions. 

3; Activities in both the respondent and operant modes should be 
structured to allow students the choice of working independently or with others. 

Since the Social Ler^rning Environment factor showed the greatest amount 
of variation, the developers should attempt to give teachers more specific in- 
formation on how to construct a classroom atmosphere which is conducive to the 
problem-solving process* Teachers might be asked to recognize how elements of 
the environment influence problem-solving in the classroom. In addition, sug- 
gestions might be made as to how changes in the physical, social, and psycho- 
logical environments within classrooms would contribute to independent action; 
and critical thinking. Particular attention should be paid to accommodating ; 
individual differences and maximizing group interaction. 

Revisions in the structure of curriculum units and the lessons which 
comprise these units may also serve to facilitate students' problem-solving 
abilities. The presence of a two-dimensional Mass stage suggests that the in- 
ductive teaching strategy is being used to arrive at an awareness of the 
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existence of a problem to be solved. This phenomenon can be utilized to in- 
crease students' understanding of the problem-solving process itself. Specific- 
ally, the Mass lesson in a unit should focus not only on the emergence of a 
problem, but equally upon the conscious definition of the process to be used in 
solving the problem. Within all lessons specific parts of the problem-solving 
process should be highlighted with particular emphasis on the generalizabi li ty 
of the process to more than one problem. If the general process, as well as the 
specific problem, were a major focus of each lesson, it would not be unreasonable 
to anticipate an increase in students* critical thinking skills. An increase in 
student independent action would also be expected if this renewed emphasis^ on 
student understanding of the problem-solving process were combined with the 
earlier suggestions regarding teacher information in the implementation of the 
Problem Resolution^, Application of Learning, and Social Learning Environment 
factors. 

FORMAL TEACHER TRAINING 

The degree of variation in the implementation of the Social Learning Curri- 
culum suggests that teachers do not fully understand the M-D-I structure and the 
problem-solving process demonstrated in this study. More formal attempts at 
facilitating the classroom implementation of the curriculum appear needed beyond 
those suggested in the previous section. This does not mean that uniformity is . 
what is required. In fact, the creative adaptation of the curriculum to each 
unique teaching situation must be encouraged. However, implementation of the 
curriculum should reflect the problem-solving process within the M-D-I frame- 
work and the creation of an environment conducive to that approach. It has been 
found that the way pupils learn is influenced by the environment in which that 
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learning takes place (Walberg, 1969). It would appear, then, that teachers 
need to recognize aspects of the environment that influence individual and 
group problem solving. A formal teacher implementation program might include 
activities which are designed to assist teachers in structuring the environment 
so as to facilitate pupil problem solving. 

There are several ways to communicate t^-teachers how- the SLC is to be 
implemented. The first is within the context of the curriculum itself, as 
discussed previously. A second approach is through orientation to the materials 
prior to the use of the curriculum. A third approach is through direct teacher 
training in small groups using a number of well defined techniques, particularly 
micro-teaching. A fourth approach is the provision of a self-contained auto- 
instructional package which would accompany the curriculum. 

The Social Learning Curriculum is uniquely experiential in nature. It 
logically follows that a program designed to train teachers in the use of a curri- 
culum which emphasizes student learning through guided activity and problem 
solving should itself be experiential ly oriented. This notion also finds support 
in the work of a number of researchers in teacher training (Goldstein, Mischio, 
and Minskoff, 1969; Amidon and Hough, 1967; Flanders, 1970; Stanford Center for 
Research and Development in Teaching, 1974). These investigators have concluded 
that teacher training which is experiential in nature yields greater success in 
affecting teacher behavior than programs of a more traditional, didactic nature. 

While small training groups would seem to provide an optimal setting, this 
approach makes the greatest demand on time, money and ftaff invol vement. Addition- 
ally, small training groups would require the presence of a skilled leader, thus 
limiting drastically the number of teachers who could be reached. Therefore, an 
auto-instructional program as part of the SLC "package" would appear to be a 
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reasonable way of meeting a demonstrated need. This program might include 
optional activities where a workshop setting is possible. While it is beyond 
the scope of this monograph to delineate the format, goals, and content of such 
a program, certain suggestions are warranted. 

The results of this study provide an empirically sound foundation for the 
construction of a teacher training program. Such a program should focus, at least 
in part, on competencies generated from the five factors which characterize the 
implementation of the SLC: Problem Emergence, Problem Clarification, Problem 
Resolution, Application of Learning, and the Social Learning Environment. The 
activities needed to develop these competencies should be germane to the realities 
of the classroom. That is, since the curriculum itself is used in the context of 
teacher-student transactions, training activities for teachers should also be de- 
signed with this context in mind. It may, in fact, be parsimonious to develop a 
short-term program with two goals: first, giving teachers the experience of the 
SLC implementation process and, second, giving students experience with the problem- 
solving strategy, emphasizing that strategy rathfer than the resolution of the 
particular problems at hand. 

Finally, such a program could include a reduced version of the SLERS to 
enable teachers to monitor their own teaching. This scale Would consist of a small 
number of items, perhaps the four to six highest loading items defining each factor. 
The revised scale would enable teachers to focus on both their own and their 
students' behavior with regard to each of the five factors. The inclusion of the 
revised scale would also provide an opportunity for additional classroom research 
and evaluation. Specific issues regarding these applications of the instrument are 
discussed in the next section. 
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INSTRUMENT DEVELOPMENT. REFINEMENT. AND USE 

The purpose of employing factor analytic procedures in this study can 
be conceptualized in two ways. First, and most important, the procedure permits 
the examination of the underlying dimensions of the SLERS in relation to specific 
hypotheses derived from the M-D-I model of the SLC. Second, the factor analytic 
solution can be regarded as an effort at data reduction and parsimony— that is, 
from a practical standpoint that results justify a reduction from the original 
sixty item scores to a smaller subset of five (factor) scores that could be em- 
ployed in subsequent studies or by supervisors and/or administrators in our field 
test network to focus their observations of their teachers implementing the SLC. 
In this particular situation, the factor analytic results can be used as an aid 
in item analysis and test construction with respect to the SLERS. 

Factor scores are measures of the classes (teacher and student behavior) 
on the factors. Since five factors were found to underlie the sixty original 
items, it is possible to obtain just five scores calculated from the factors. 
Here is a simplified example with the factor matrix in Table 10. Suppose that 
one desired to calculate the Factor 2 score for a class. The raw score of the 
class on the five teacher items and the four student items, say, are 
2,4,3,5,1,3,2,5, and 3, respectively. These scores can then be multiplied by the 
related factor loadings for Factor 2 as follows: (.57)2 + (.57)4 + (.49)3 

+ (.45)5 + (.42)1 + (.63)3 + (.49)2 + (.42)3. This classroom's F2 score is 13.79. 
The factor 2 score for other classrooms can„be computed in the same way. However, 
it should be mentioned that this is not the only way to calculate factor scores. 
This example was given to convey the Idea that such scores are weighed averages, 
the weights being the factor loadings. The point is that instead of using many 
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scores, fewer factor scores can be used. 

There exists a considerable number of formal empirical procedures for 
appropriately obtaining the five factor scores from the original sixty items. 
For a more complete discussion of these methods see Harmon (1960). However, 
since the principal use of any factor scores obtained in this study would 
probably be with another sample of classes and with a reduced set of items, 
these procedures may not be appropriate. First, they require the. use of all 
the items to calculate a factor score. Including all the items in any future 
work, however, may not be possible nor does it appear necessary given the re- 
sults obtained ficre. Thus, only a limited number of crucial items need to be 
retained as the basis of the factor scores. Second, since the formal procedures 
capitalize on chance in the initial analyses, part of the solution will be 
based on nonsignificant differences. Thus, generalizations of complex weighting 
procedures from sample-to-sample are seldom as stable as one would^e;<peGt^--- 
(Guilford, 1965; Schmidt, 1971). Instead of using all items to estimate a factor 
score through a complex weighting procedure, a small set of items can be given 
simple weights to estimate a factor. This procedure permits a smaller number 
of items to be used in practical applications in the classroom and reduces the 
capitalization on chance (error). Where good data are available, further work 
might even be based on single items as a measure of a factor. More on this 
approach in a moment. 

The first step in building an appropriate weight matrix is to determine 
which items are crucial and which are irrelevant based on the factor weight 
matrix. A crucial item may^^jbe defined as one with a weight of at least .40 on 
a factor; all other items are excluded. This, in fact, was the procedure for 
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retaining items employed in this study as presented in Tables 9 through 13 as 
well as the basis for making interpretations concerning the underlying factor 
structure. The weights or values assigned to the crucial items can be de- 
termined by several methods. One method would be to give each crucial item a 
weight equal to its correlation with the factor. This approach is similar to 
the procedure suggested on the previous page and appears most appropriate for use 
in subsequent empirical studies designed to cross-validate the factor structure 
obtained here or to examine differences in the factor structure as a function of 
SLC content. The resulting scale would consist of 52 of the original items — 
that is all of those s'pecified in Tables 9 through 13. The weighting equations for 
converting a class's score on these items into the five factor scores are presented 
in Table 18. 

This version of the instrument might also be employed to permit ca^peful 
classroom monitoring and/or facilitation of the M-D-I structure, problem-solving 
-•process, and inductive teaching strategy by center staff or school administrators 
and field test advisors involved in the field testing of the Social Learning Curri- 
culum. The items associated with each of the five factors could be used as a guide 
to observing a particular class without the need to actually compute a factor 
score. In this particular application there is less concern about the possibility 
that items might be redundant in an empirical sense and more concern about the re- 
presentativeness of the items associated with a factor as well as their ability 
to provide clear direction to those making the observations. As an example, we 
might refer to the two items that were eliminated in the analysis of the factor 



75 



-45- 



structure because they had a zero frequency of occurrence and were not dis- 
criminating. Item #16 requires the teacher to provide opportunity for different 
task-related activities to occur simultaneously, while item #49 requires the 
student to make use of activity centers independently or in a group. These items 
were eliminated in the interests of scientific parsimony. However, it is sig- 
nificant that they did not occur because of the possibility that there was no 
provision for them in the curriculum itself. Both items are examples of ways of 
providing for independent action on the part of pupils within the classroom, and 
independent action is one of the major pupil outcomes specified by the curriculum 
developers. For this reason, the use of factor analytic criteria £ejr se in 
eliminating items from the scale does not appear completely satisfactory for this 
type of application. 

In suninary, then, an approach more in keeping with this application would 
be to explore several criteria for including items in this scale. One criterion 
might be the degree-.to which an item is logically and theoretically representative 
of a factor rather than strictly relying on whether or not the behaviors specified, 
by the item were actually observed. To consider occurrence alone may cause items 
that are theoretically relevant to the original purpose of the scale to be 
eliminated. Another criterion would be to include more items with each factor for 
their explanatory value even though the rule of scientific parsimony is violated. 
These suggestions would serve as a more meaningful basis for using the SLERS in 
attempts to increase teachers' repertoire of behaviors concerning the M-D-I 

structure and the problem-solving process. 

J 

The simplest and most practical procedure, however, would be to let each 

factor be represented by four items— the two highest loading teacher items and 

the two highest loading student items. This approach would reduce the entire 

SLERS instrument to 20 items— four items for each of the five factors. Table 19 

contains this version of the instrument. 7^"> 
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Practically speaking, this approach appears to be the most useful for assisting 
supervisors and administrators who are interested in quickly and efficiently 
observing their classrooms implementing the SLC with minimum loss of significant 
information. If the classroom is a unit of concern, the supervisor would be 
guided in the observation by both teacher and student items. However, if 
teacher behavior were of primary consideration, only ten items would be needed 
as a guide. Furthermore, this practical version of the SLERS should provide a 
reasonable focus for observations regardless of the specific phase of function 
being taught. 

ROLE OF EVALUATION ACTIVITIES AT THE CURRICULUM RESEARCH AND DEVELOPMENT CENTER : 

The development and use of the SLERS as an empirical instrument demon- 
strates the role of evaluation activities at the Curriculum Research and Develop- 
ment Center. That role is to' share responsibility with the development unit for 
the curriculum that is produced. There are three major contact points or stages 
involving simultaneous evaluation and curriculum development activities—each of 
which will be demonstrated in this series of three monographs. These stages are: 
1 ) refining objectives for a particular unit of the SLC; 2 ) developing in- 
struments to assess the degree to which these objectives are implemented and 
achieved, and 3 ) analyzing and interpreting data for the purpose of revision and 
future development. These stages are highlighted in Figure five based on our pre- 
viously established general working model.- See Warshow, Bepko, and Becker (1974) 
for further discussion of this model. 

The boxes .containing asterisks indicate the parts of the stages or con- 
„tact points involved in the construction of the SLERS. The instrument is unique 
in that it attempts to provide information on both the M-D-I structure problem- 
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TABLE 19 
PRACTICAL VERSION OF SLERS 



Teacher Behavior 



Student Behavior 



Problem Emergence Factor 



Teacher assists pupils in separating 
relevant from irrelevant information 
with respect to the problem to be 
solved. 

Teacher implements the experience by 
focusing primarily on task rather 
than on self. 



1. Pupils label and detail 
appropriately. 



2. Pupils articulate alternative 
solutio^ns' to a problem. 



1. 
2, 



Problem Clarification Factor 



Teacher provides opportunity for 
pupils to make associations between 
ideas. 

Teacher draws on background and 
experiences of pupils. 



1. Pupils make associations 
between ideas. 

2. Pupils articulate problems re- 
lated to the objective. 



Problem-^Resolution Factor 



Teacher provides opportunity 'and 
helps pupils to use previously 
acquired concepts and skills in 
a new or different situation - 
with teacher help. 
Teacher provides opportunity for 
pupils to try out solutions to 
a problem. 



Pupils use previously acquired 
concepts and skills in a new 
or different sjtuation - with 
teacher help. 

Hupils try out solutions to a 
problem. 



Application of Learning Factor 
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1. Teacher provides opportunity for 
pupils to show that they have learned 

or understood something by solving a problem 

2. Teacher provides opportunity for*pupils 
to use previously acquired concepts and 
skills in a new or different situation 
without teacher help.^ 



1. Pupils work independently in 
solving a problem. 

2. Pupils use previously acquired 
concepts and skills in'^a new 
or different situation - 
without teacher help. 



The Social Learning Environment Factor 

1. Teacher allows pupils to express V. Pupils move around room in non- 
negative feelings. disruptive situations. 

2. Teacher allows pupil expression of 2. Pupils interact constructively 
positive feelings. to solve a task-related problem 



a. 



This item, which was the third highest loading on this factor, was substituted 
for the second highest loading item since it seems more highly related to the 
inductive methodology. 



-47- 

solving process and the teaching strategy specified by the curriculum developers. 
This monograph, then, can be regarded as a report of the instrument's ability to 
function in this capacity in order to satisfy evaluation needs outlined in stages 
one through three. 

The second' monograph will deal with an examination of the effect of the 
differences in SLC implementation identified here on specific student outcome 
measures. In this way, the working model at our center follows the type of 
process product investigations discussed by Rosenshine and Furst (1973) and 
employed in several follow-through projects (Soar, 1971; Stallings, 1974). 
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QUESTIONNAIRE FOR PROVIDING FEEDBACK TO DEVELOPMENT 
J. Becker, S. Poloner and E. Savage 

a) Was the activity structured to best facilitate meeting the objective? 

Yes No 

b) Please explain: 'Was success or failure of the activity due to a function 
of positive or negative" : 

Content of Curriculum Teacher Implementation Materials Student Variables 



a) Were activities implemented according to the sequencing of mini-objectives 
outlined within the experience? 



Yes No 



b) Please explain: Were changes made or not made because of positive or negative : 
Content of Curriculum Teacher Implementation Materials Student Variables 



a) Was each mini-objective a logical component of the overall objective of 
the experience? 

"(ei- No 



b) Please explain: Were positive or negative results due to: 

(+ °^ -) - (+ or -) (+ or -) (+ or -) 

Content of Curriculum Teacher Implementation Materials Student Variables 



a) Were mini-objectives stated so that the teacher had a clear idea of what 
the expected student outcomes were: 

^Yes No 



b) Please explain results as due to positive or negative : 

Co ntent of Curriculum I Teacher Implementation Materials Student Variables 
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5. a) Were any activities in the experience not used? 

* Yes ^No 

b) Which ones? Please list. 



c) Please explain omission of activity(s) as due to positive or negative : • 

Content of Curriculum Teacher Implementation Materials Student Variables 



6. a) Did the teacher create mate>ials or activities to enhance the experience? 

Yes ^^0 

b) If yes, please list: 

c) Pl8?.s8 6xpl?.in results ss 9 function of posit ivG or nsgsti vg ! 

Content of Curriculum Teacher Implementation Materials Student Variables 



7. a) Was Teacher Information complete enough in clarifying the objective? 

Yes Ho 

h) Please explain clarity or lack of clarity as a result of positive or negative : 
Content of Curriculum Teacher Implementation Materials - Student Variables 



8. a) Did the suggested dialogue and procedures for Teacher Action facilitate meeting 
the stated objective? 

Yes No 
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b) Please explain results as a function of positive or negative : 

Content of Curriculum ' Teacher Implementation Materials Student Variables 



Critical Thinking Questions : 

9. a) Did the activity encourage pupils to name objects or elements in the learning 
environment? 

Yes No 



b) Please explain results as a function of positive or negative : 

Content of Curriculum Teacher implementation Materia ls Student Va> iables 



10. a) Did the activity encourage pupils to separate relevant from irrelevant 
information with regard to the problem to be solved? 

Yes No 



b) Please explain results as a function of positive or negative : 

Content of Curriculum Teacher Implementation Materials Student Variables 



11. a) Did the activity encourage pupils to make associations between ideas? 

Yes ^No 

b) Please explain results as a function of positive or negative : 

Content of Curriculum Teacher Implementation Materials Student Variables 



12. a) Did the activity encourage pupils to articulate alternative solutions to a 
problem? 

^Yes No 
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b) Please explain results as a function of positive or negative : 

Content of Curriculum * Teacher Implementation Materials Student Variables 

13. a) Did the activity encourage pupils to try out alternative solutions to a problem? 

^yes ^No 

b) Please explain results as a function of positive or negative : 

Content of Curriculum Teacher Implementation Materials Student Variables 

14. a) Did the activity encourage pupils to predict consequences of solutions to 

the problem? 

^Yes Ho 

b) Please explain results as a function of positive or negative : 

Cnntpnt nf riim'rniMm Te?cher Tmnlenientation M?teri?ls student VariaM^^ 

15. a) Did the activity provide opportunity for pupils to use concepts and skills 

previously acquired in a new and different situation? 

Yes Ho 

b) Please explain results as a function of positive or negative : 

Content of Curriculum Teacher Implementation Materials Student Variables 

Independent Action Questions : 

16. a) Did the activity lend itself to the structuring of a classroom environment 

that reflected and encouraged optimal pupil participation? 

* _Yes No 
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b] Please explain results as a function of positive or negative : 

Content of Curriculum * Teacher Implementation Materials Student Variables 



17. a) Did the activity encourage the acceptance of the differences in pupil 
personality? 

Yes No 



b) Please explain results as a function of positive or negative : 

Content of Curriculum Teacher Implementation Materials Student Variables 



18. a) Did the activity encourage the pupils to use their own experiences? 

Yes Jlo 

b) Please explain results as a function of positive or negative : 

Content of Curriculum Teacher Impl ementation Materials Student Vari bibles 



19. a) Did the activity encourage pupil to pupil interactions (task related)? 

Yes No 

b) Please explain results as a function of positive or negative : 

Content of Curriculum Teacher Implemap^tation Materials Student Variables 



20. a) Did activity encourage pupil to pupil interactions - non-task related? 

Yes No 

b) Please explain results as a function of positive or negative : 
• Content of Curriculum Teacher Implementation Materials Student Variables 
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21. a) Did the activity provide an opportunity for individual pupils to show that 
they have learned or understood something by solving a problem related to 
the task - without teacher help? 

Yes No 

b) Pl.ease expTdln. results as a function of positive or negative ; 

Content of Curriculum Teacher Implementation Materials Student Variables 



22. a) Was there any critical event (unusual occurrences) that best explains the 
success or failure of the activity? 

^Yes No 

b) Please explain the event as a function of positive or negative : 

Content of Curriculum Teacher Implementation Materials Student Variables 



Other? 
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